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it 


1. 


Introduction, 


If  the  characteristic  function  (c.f. )  of  an  n-ditnensional  random 


vector  x  has  the  form  exp(it  ’y)<j>  (t  ’Zt) ,  where  y;nx  1,  £:nx  n, 

rk  Z  =  k,  Z  >_  0,  and  cj>  e  =  {(f)  |  <p  (t)  is  a  c.f.  such  that  <p  (t^  +  •  •  •  + t?) 

K. 

is  a  c.f.  on  H  },  we  say  that  x  is  distributed  according  to  an 

elliptically  contoured  distribution  with  parameters  y,  Z  and  <j> ,  and 

write  x  'V  EC  (y,Z,<j>). 

~  n  ~  ~ 

Elliptically  contoured  distributions  have  been  extended  to  the  case 
of  matrices  by  Dawid  (1977,  1978),  Chmielewski  (1980),  and  Anderson  and 
Fang  (1982b). 

Let  X,  M  and  T  be  n  x  p  matrices.  We  express  them  in  terms  of 
elements,  columns,  and  rows  as 


^  j  j  )  (^  -I ,  •  • » » x  ) 

ij  ~i  ~p 


~  (^ij)  (Wi»  •  •  •  * V  )  — 


?(D 


~(n) 


fra)  1 


(n) 


x  =  vec  X’  , 


y  =  vec  MT  , 


T  .)  (t^,...,t  )  — 


ij' 


V  ' 
~(1) 


~(n) 


t  =  vec  T’ 


Here  x  -  vec  X’  =  (x|^,..,,x!  p1  with  the  corresponding  meanings  for 
and  t . 
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If  the  c.f.  of  a  random  matrix  X  has  the  form 


(1.1) 


“p(1  Jx  ia)Ka)w<3(i)5i£(i) 


with  0,  we  say  that  X  is  distributed  according  to  a 

multivariate  (rows)  elliptically  contoured  distribution  (MECD)  and  write 
X  'v  MEC^X  <(>)  .  In  this  paper  we  consider  only  the  subclass 

of  MECD  in  which  the  function  <J)  satisfies 


(1.2) 


. . .  >t^)  4* ? 


we  continue  to  denote  MECD  in  this  subclass  by  MEC  (M;E,,..*,£  ;(j)) 

n  x  p  ^  ~  _L  n 

,(q) 


Let  u 


denote  a  random  vector  which  is  uniformly  distributed  on 
the  unit  sphere  in  and  J2  (l-tl  )  denote  its  c.f..  Schoenberg  (1938) 

pointed  out  that  a  c.f.  <J>  e  if  and  only  if 


(1.3) 


4>(u)  =  /  fim(ur  )dF(r) 


for  some  distribution  function  F(x)  on  [0,«>).  Since  $  D  $  for 

m  <  n  if  the  distribution  function  F  of  R  is  related  to  <J>  as  in 

(1.3)  with  n  substituted  for  m,  then  ([>  e  $  ,  m  <  n,  and  there 

exists  a  distribution  function  F*(x)  of  R*  being  related  to  <(>  as  in 

(1.3)  with  F*  substituted  for  F.  There  exists  a  relationship  between  R 
t  d  o 

and  R*,  that  is  R*  «  Rb,  where  b  >_  0,  b  ^  B(m/2,  (nnn)/2),  b  is 

independent  of  R,  and  x  “  y  denotes  x  and  y  have  the  same 
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distribution.  (cf.  Cambanis,  Huang  and  Simons  (1981).)  For  convenience 

we  denote  these  relationship  by  R  +->-  <f>  e  $  and  R*  =  R  b  ,  „  .  -w  6  e  $ 

n  m/2,(n-m)/2  ri 

Throughout  the  paper  we  assume  that  X  'V  MEC  (M:Z  Z  •d)') 

~  nxp 

with  n  >  p,  E^  >  0» • • • >2n  >  0,  <fi  and  X  has  a  density  of  the 

form 


(1.4) 


n  I z±r1/2 

i=l  1 


8lJ1(^(i)^(i>),5i  (~(i)"H(i))] 


In  this  case  X  can  be  expressed  as  following 


^1’5^  ~  ~  +  ^Rl~(l)~lP^’ •  ",Rn~(n)~nP^  ’  ’ 


where  R^ ,  j  =  l,...,n,  are  independent  of  ujP^ >  1  = 

1  ,u(p)  are  independent .  u  =  •• 

~n 


^1  » •  •  •  »Un  are  ^nd ep end ent ,  u,  -  u  ,  Z_.  =  AlA^  is  a  factorization 


~3  '  -3  -3-3 

of  j  j  “  1, . .  •  ,n,  R^  ^  0 9 .  • . , R^  ^  0  and 


(R1 . Rn>  “  r2«1 . V  > 


where  (d^  . . . , d^)  ^D^p/2 . p/2;p/2),a  Dirichlet  distribution, 

_  ...  _  d  R  is  nonnegative  and  independent  of  d. ,....d  , 

±  n— x  1  xi 


d  =  l-d„  - 
n 


and 


(1.6) 


n 


^  '  j1(5(cO-Hto))’5to)(J(o,)-!;(a)> 


When  jj-^,  =  ...  =  =  y  and  E1  =  •  •  •  =  E^  =  E,  we  write 


‘(n) 


~n 


X  %  LEC  (y,E,(j)).  In  this  case  (1.4)  reduces  to 

~  II  a  P 
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(1.7) 


| E | -n/2g(tr  E-1G)  , 

where 

(1-8)  S  ■  Ji  ^(tO^CcOi!5' 

and  (1.6)  is 

(1.9)  R2  =  tr  E_1G  . 

The  maximum  likelihood  estimators  and  the  unbiased  estimators  of 

y  and  Z,  and  their  distributions  are  studied  in  Section  2  and  some 

discussion  on  the  existence  and  uniqueness  of  maxima  is  given.  In 

Section  3  we  extend  many  basic  likelihood  ratio  criteria  from  the  normal 

case  to  the  MECD  case.  We  find  that  most  of  the  criteria  and  their 

corresponding  distributions  are  the  same  in  the  class  of  MECD.  A  similar 

discussion  on  testing  the  general  linear  hypothesis  is  given  in  Section  4. 

Throughout  the  paper  Nn(y,E)  denotes  the  n-dimensional  normal 

distribution  with  mean  y  and  covariance  matrix  E;  B(an ,a0)  denotes 

the  Beta  distribution  with  parameters  a.  and  a0;  D  ,  ;a  ) 

denotes  the  Dirichlet  distribution  with  parameters  F(k,m) 

denotes  F-distribution  with  k  and  m  degrees  of  freedom,  W^(Z,n)  denotes 

the  Wishart  distribution  with  p  x  p  covariance  matrix  E  and  n  degrees 

of  freedom;  U  denotes  Wilks’  distribution  which  is  the  distribution 

p,m,n 

of  the  ratio  |g|/|G+H|,  where  G^Wp(E,n),  H'\>Wp(E,m),  and  H  and  G 
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are  independent;  denotes  the  n  x  n  identity  matrix;  denotes 

the  n  x  1  vector  with  elements  1;  rk  A  denotes  the  rank  of  the  matrix 
A  and  tr  A  denotes  the  trace  of  A. 


2.  Estimation  of  y  and  £  and  their  distributions* 
Assume  X  'v  LEC^  x  ^(u,Z,<j))  and  X  has  a  density 


(2.1) 


|E|~n/2  g(tr  E  1G)  , 


where  G  is  defined  by  (1.8) .  Let 


(2.2) 


~m  A  • 


where 


(2.3) 


t 


Then  W  =  X'DX,  with  D  =  I  -  (l/n)e  e\ 


Lemma  1.  If  n  >  p,  then  G  and  W  are  positive  definite  with  probability  one. 


Proof .  From  the  assumption  and  (1.5)  we  have 


(2.4) 


X  =  e  y’  +  RUA  , 

~  ~n  ~  ~  ~ 


where  U:n  x  p,  vec  U  =  Arp  x  p  and  A'A  =  E  >  0.  Hence 
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where  Y:n  x  p  with  i.i.d.  elements  distributed  according  to  N(0,1). 

2 

Since  YTY  >  0  with  probability  one  and  P(R  >  0)  «  1,  then  P(G  >  0)  =  1 . 
The  property  for  W  is  proved  similarly.  Q.E.D. 

In  order  to  obtain  the  maximum  likelihood  estimators  of  ]i  and  £ 
we  need  the  following  lemma. 

Lemma  2.  Assume  that  g(*)  is  a  decreasing  and  differentiable  function 
2  2  N 

such  that  cg(x^  +  •••  +  x^)  is  a  density  in  ]R  ,  where  c  is  a  constant. 
Then  the  function 


(2.5) 


h(x)  =  xN^2g(x) 


x  >  0 


has  a  maximum  at  some  finite  x^  >  0,  and 


is  a  solution  of 


(2.6) 


g’(x)  +  (N/2x)g(x)  =  0  . 


2  2 

Proof .  Since  cg(x^  +  •••  +  x^)  is  a  density,  we  have 

oo  >  J.  •  •  J  g(x 

V 

using  the  transformation  to  spherical  coordinates  (Anderson  (1958) ,  Chapter 
7,  Problem  4,  for  example),  and 


+  vdv 


■dXN  " 


N/2 

IT 

n(N/2) 


N/  2-1 


g(x)dx 
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2-i/2C2x),,/2g<2lt>  -  x^2g(2x)  <  x^2'1  J^gCtJdt  <  /V^gCOdt  *  0 

X  X 

as  x  -»■  0°,  i.e.,  h(x)  =  xN^2g(x)  ->  0  as  x  °°.  By  this  fact  and 

h(0)  =  0,  h(x)  0  for  Vx  0,  the  first  assertion  of  the  theorem  follows. 

Now  assume  that  h(x)  has  its  maximum  at  xQ  >  0;  then 

0  -  h’(x0)  =  Xq/2[ (N/2xQ)g(x0)  +  g'(x0)]  , 

which  completes  the  proof,  Q.E.D. 

From  Lemma  2,  when  N  =  np,  the  function 

(2.7)  f(X)  =  X“np/2g(p/X) 

arrives  at  its  maximum  at  some  finite  \  .  Throughout  the  paper  we  denote 

this  Xn  by  X  (g)  . 

0  J  maxX6/ 

It  is  well-known  that  if  hT(xQ)  =  0  and  h!t(xQ)  <  0  (if  it  exists), 
then  h(x)  has  a  local  maximum  at  x^.  If  there  exists  a  unique  such 
Xq,  then  h(x)  has  a  unique  maximum  at  x^.  In  the  proof  of  Lemma  2  we 
see  that  h1  (x^)  =  0  if  and  only  if  Xq  is  a  solution  of  (2,6),  Further 
if  this  Xq  satisfies  the  following  inequality 

gn(xQ)  <  (N(N+2)/4x2)g(xQ)  , 


then  h"(x  )  <  0. 

Lemma  2  shows  us  that  the  equation  (2.6)  has  at  least  one  solution  if 
g(*)  satisfies  the  conditions  of  Lemma  2.  For  example,  if  g (x) =  exp(-ax) , 
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a  >  0,  then  the  equation  (2.6)  has  a  unique  solution  Xq  =  N/2a. 

“X  “X 

If  g(x)  =  e  exp(-e  ),  the  equation  (2.6)  becomes 

e“X  =  1  -  N/2x  . 

It  is  easy  to  see  that  this  equation  has  a  unique  solution  Xq(>  N/2) . 
The  following  are  some  computations: 


8  4.069529635 

10  5.032816088 

12  6.014691496 

20  10.00045381 

30  15.00000459 

40  20.00000004 


We  can  combine  these  two  examples  to  obtain  the  following  interesting 
example  in  which  the  equation  (2.6)  has  two  solutions.  Taking  N  =  6, 
let 

g (x)  =  e-x  ,  0  <x  <  6  , 

-X  ,  -x.  6.014691496  <  x  <  °°  . 

=  e  exp (-e  ),  — 

and  the  values  of  g(x)  on  interval  (6,  6.014691496)  depend  on  a  poly¬ 
nomial 

3  2 

p(x)  =  a^x  +  a^x  +  a^x  +  a^ 

such  that 

p(6)  =  g(6),  P(6. 014691496)  =  g(6. 014691496)  , 

p T (6)  =  g T (6) ,  p’ (6.014691496)  «  g f (6 . 014691496)  . 
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According  to  this  requirement,  we  find 


aQ  =  4.2951974,  =  -77.4064525,  a2  =  464.9942434,  a3  =  -931.0921074  , 

by  calculation.  It  is  easy  to  check  that  the  g(x)  is  decreasing  and  differ¬ 
entiable,  and  the  corresponding  equation  (2.6)  has  two  solutions:  Xq^  =  6 
and  “  6.014691496  (cf .  the  above  first  example  with  a  =  1  and  N  =  12 

and  another  example  with  N  =  12)  .  In  this  case  we  need  to  compare  the 
values  of  h(x)  at  x^  and  XQ2*  We  ^ave 

h(6)  =  66e"6  =  115.4686616 

and 

h(6. 014691496)  =  (6. 014691496) 6e-6 -014691496  exp(-e~6’014691496) 

=  115.364451  . 


Thus  h(x)  arrives  at  its  maximum  at  6. 

Now  we  come  back  to  the  maximum  likelihood  estimators  of  y  and  Z. 

Theorem  1.  Assume  that  X  ^  LEC  (y,Z>d))  with  n  >  p  and  X  has  a 
-  ~  nx  p  z  ~  T  ~ 

density  (2.1).  Further  assume  that  g(#)  is  a  decreasing  and  differentiable 
function.  Then  the  maximum  likelihood  estimators  of  y  and  Z  are 


y  =  x  and  Z  =  ^^(g)^ 
~  ~  ~  max  ~ 


Proof .  It  is  easy  to  see  that 

log  L(y,E)  =  -(n/2)  log  \z\  +  log  g[tr  E_1W  +  n(x-y) ' S_1 (x-y) ]  . 
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The  assumption  that  g(*)  is  decreasing  and  E  >  0  shows  us  log  L(y,E) 
arrives  at  its  maximum  at  y  =  x  and  the  concentrated  likelihood  is 

(2.8)  log  L(x,E)  =  -(n/2)  log  |E|  +  log  g(tr  E  1W) 

By  Lemma  1,  W  >  0  with  probability  one.  So  there  exists  a  nonsingular  matrix 
C  with  probability  one  such  that  CC’  =  W.  Let  E  =  C  EC'  .  We  then  have 

log  L(x,E)  =  -(n/2)  log  IeI  -  (n/2)  log  |w|  +  log  g(tr  E_1)  . 

~  ~  ^  ~  ~ 

There  exists  an  orthogonal  matrix  T  such  that 

T'Er  =  A  -  diag(X1,...fX  ) 

with  X15...,X  >0.  Therefore 

1  P 

P  E  ,  , 

log  L(x, E)  =  -(n/2)  Y  log  X.  +  log  g(  l  1/X.)  -  (n/2)  log  |w| 

i=l  1  i=l 

=  f(X1 . X  )  -  (n/2)  log  |W|  , 

say.  As  f(X^',...fX2)  is  a  symmetric  function  of  X^,...^  ,  we  have 

X  =  X„  =  •••  =  X  =  X,  say.  The  function  f(X1,...,X  )  reduces  to 
1  l  P  L  P 

(2.9)  f (X)  =  -(np/2)  log  X  +  log  g(p/X)  . 

The  theorem  follows  by  Lemma  2.  Q.E.D. 
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It  is  clear  from  log  L(vi,E)  that  x  and  W  are  a  sufficient 
set  of  statistics  for  u  and  E. 

From  the  proof  of  Theorem  1  we  have 


(2.10) 


max  L(U,E) 
>0 


=  X 


max(g) 


■np/2S(p/*max<g))iwr"/2 


In  the  normal  case 


g(x)  =  (2tt) 


-np/2  -l/2x 
e 
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which  satisfies  the  conditions  of  Theorem  1.  As  is  well-known  there 


exists  a  unique  solution  X  ,  N  =  l/nt  and  Z  35  (l/n)W. 

max(g)  9  ^  „ 

Now  we  want  to  obtain  the  distributions  of  x  and  \  ,  .  W. 

~  max(g)  ^ 


If  X  't  LEC  (0,E,  <j>)  With  P(X=  0)  =  0,  and 

~  n  ^  p  —  'v  <v  <v 

the  distribution  of  X’X-  is  denoted  by  M  „ 
and  Fang  (1982b)  have  obtained  the  density  of 


X  = 


X. 


l~2j 


with  X^:m  x  p, 
(E;m/2;  (n-m)/2;<j>)  .  Anderson 


M  ?(E;m/2;  (n-m)/2;cj))  . 

P  ,  Z  - 


Theorem  2.  Assume  that  X  ^  LEC  _  (p,Z,d))  with  n  >  p  and  X  has  a 

-  nx  pvCL,T/  r 

density  (2.1).  Then 

(1)  the  joint  density  of  x  and  W  is 


(2.11) 


np/ 2^ (n-l)p/ 2-p (p-1) / 4 
n  r ( (n-j )/2) 


| W |  (n  P)/2_1 1 E |”n/2g(tr  E  VnCx-y)  'ifhx-y)) 
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(2)  ^  ECp(y,(l/n)E,<{))  with  <f>  e  $p  +->  R*  =  Rbp/2>  (n_1)p/2; 


(3)  W  ^  MGp  2^5  (n-l)/2;y;<j>),  where  ^  R** 

Rb^  l)p/2  p/2  anC^  t*ie  density  of  W  is 


(2.12) 


.2 ^^IrlV4.  |z|-n/2|H|<»-p)/2-l  j”rP-lg(r2+tr  E-lw)dr 


r(P/2)  n  r((n-j)/2) 

j=i 


o 


Proof .  Let  B  be  an  n  x  n  orthogonal  matrix  with  the  last  row 
(1/A, . . .  ,1/A)  and  Y=  (y ^  ,  . . .  ,y ^  )  '  =  BX.  Then 


y/«\  =  A  x  , 


(n) 


n-1 


-  *  ^  • 


From  Corollary  2  of  Lemma  2  of  Anderson  and  Fang  (1982b)  we  have 


vec(Y)  «  vec(BX)  ^  EC  (y  x  (Be  ),£  x  (BBf),cj)) 
»v  ~  ~  np  ~  — ,n  ~  ~  ~ 


Thus  we  have 


and 


u  ®  (B£n)  =  u  ®  (o»  •  • .  ,o,i/A) ' 


E  ®  (BB  * )  -  E  ®  I 

~  'v  ~  ~  -n 


Using  Lemma  13.3.1  of  Anderson  (1958)  and  y^*  =  Ax,  (2,11)  follows, 
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Since  ?  “  X’DX  with  D  =  In-(l/n)ene^,  rk  D  =  n  -  1  and  D2  =  D, 
W  'V'  MGp^2(E;  (n-l)/2;-|-;4))  from  Theorem  9  of  Anderson  and  Fang 
(1982b)  and  the  density  (2.12)  follows  from  Section  5.1  (2) (B)  of  the 
same  paper.  The  assertion  (2)  follows  by  Corollary  2  of  Lemma  2  with 
B  =  (l/n)e^  of  Anderson  and  Fang  (1982b).  Q.E.D. 

The  next  natural  question  is  what  are  the  unbiased  estimators  of 
y  and  £?  We  need  the  following  lemma: 

Lemma  3 .  Assume  x  ^  EC^(y,E,<j))  with  <j>  R  and  ER^  <  <».  Then 
(2.13)  Ex  -  y,  and  E(x-y)  (x-y)  ’  =  (ER2/n)£  . 

(cf.  Cambanis,  Huang  and  Simons  (1981).) 

Theorem  3.  Assume  that  X  ^  EC  (y,Z,<j>)  with  <p  e  $  -*-*■  R  and 

~  n  x  p  ~  ~  T  r  np 

2 

0  <  ER  <  °°.  Then  the  unbiased  estimators  of  y  and  £  are  y  =  x 
and 


(2.14) 


Z  = 


JUL 


(n-l)ER' 


2  ? 


respectively. 


Proof .  From  Theorem  2  and  Lemma  3  the  first  assertion  is  obvious.  Using 

n-1 

the  notation  of  the  proof  of  Theorem  2,  we  have  W  =  £  y  .  yl  If 

~  j  —  ) 

we  can  prove  =  (ER2/np)E,  j  =  1 . n-1,  then  (2.14)  follows. 

It  is  easy  to  show  that  y...  'V  EC  (0, 2, cf>)  with  <b  6  $  ■*-*•  R*  =  Rb  ,n. 

P  ~  ~  P  p/2,(n-l)p/2 
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j  =  l?...,n-l  (cf.  Lemma  2,  Anderson  and  Fang  (1982b)).  By  Lemma  3 
and  the  moments  of  Beta  distribution 


E~(j)~(j)  =  =  (ER2/np)Z  , 


which  completes  the  proof.  Q.E.D. 

Example  1.  (Multivariate  t -distribution) .  Let  X  be  an  n  x  p  random 
matrix  with  i.i.d.  rows  distributed  according  to  N^(y,E)  and  s  'V 
be  independent  of  X.  Let  Y  =  A)X/s,  then  the  rows  of  Y  and  vec 
have  the  multivariate  t -distributions .  It  is  easy  to  verify  the  following 
facts  (cf .  Johnson  and  Kotz  (1972)  and  Anderson  and  Fang  (1982a)): 

(1)  The  density  of  Y  is 


r[(np+v)/2] |Z 


-n/2 


(2.15) 


T(v/2)  (irv) 


np/2 


<1  +  v"1  tr  GE_1)  1/2(np+V) 


where 


n 


G  * 


(2)  Y  'v  LECnXp(y,E,4.)  with 


(2.16) 


.  .  ..  .  -1  N -l/2(np+v) 

;(x)  =  c(l+V  x)  r  , 


where 


c  =  r((np+v)/2)/r(v/2)/(7rv) 


np/2 
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l  »-< 


Therefore,  g(x)  satisfies  the  conditions  of  Theorem  1  and  \  (e)  =  1/n 

max  & 

(3)  The  maximum  likelihood  estimator  of  E  is  W/n,  where  W  is 
defined  by  (2.2)  with  x  substituted  for  y. 

(4)  The  unbiased  estimator  of  E  is  ((v-2)/(n-l)v)  W. 

3 .  Likelihood  ratio  criteria. 

In  this  section  we  study  problems  of  testing  hypotheses  about  mean 
vectors  and  covariance  matrices  for  the  elliptically  contoured  distributions.  The 
likelihood  criteria  are  obtained  by  a  unified  technique.  We  find  that  most  of 
these  likelihood  ratio  criteria  are  independent  of  the  specific  form  of  the 
density  in  the  class  of  MECD. 

3.1  Testing  lack  of  correlation  between  sets  of  variates. 

Assume  that  X  -V  LECn  x  (y,  E,<j>)  with  n  >  p  and  X  has  a  density 
(2.1)  where  g(x)  is  a  decreasing  and  differentiable  function.  Partition 


y,  E,  and 

W  as 

'  H(1>' 

follows: 

r  > 

?11  ***  5lq 

~11  ~lq 

(4.1)  y  = 

.  ^  J 

,  E  = 

* 

•  • 

•  • 

E  1  •  E 

~qi  ~qq 

L  j 

,  w  = 

1 

•  * 

•  * 

•  « 

w  w 

L~qi  ~qq 

v.  (1)  (q) 

wnere  y  ,...,y  have  p^,...,p  components,  respectively,  and 
E..  and  W..  are  p  x  p  matrices,  i,j  =  l,...,q.  Let 

~-LJ  1  J 
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(3.2) 


?0  = 


hi  2 


.  0 


0  ?22  *•*  2 


0  0  ...  Y 


„qq 


then  ZQ  >  0  if  and  only  if  >  0*  Testing  lack  of 

correlation  between  sets  of  variates  is  equivalent  to  testing  the  hypothesis 

5“  Eo- 

Lemma  4 ,  Under  the  assumptions  of  Theorem  1 


(3.3)  ^  L(y,I0)  -  Xmax(g)-"t'/2(  j  |W  rn/2)g(p/XMX(g))  . 


u ,£0 >  0 


j=i 


Proof .  To  show  the  pattern  we  consider  only  the  case  of  q  =  2.  By  a 
method  similar  to  that  used  in  the  proof  of  Theorem  1,  we  have 


max  L(]i,En)  =  max  L(x,En) 

H-5o>0  '  5o>0 


{-(n/2)  n1  log  x?1*  -  (n/2)  n2  log  xf2)  +  log  g(  n1xf1) 

''1-'  >  n  -i=i  3  -s=i  3  -i=i  3 


Xr'  >  0 
2 

3  =  1>  •  • • >Pj 

i-1,2 


j=l 


j=l 


j=l 


+  S2  X{2)  )  -  (n/2)  x  (log |W  |  + log |W22 | ) }  , 

j=l  3 


(1)  ,  (1) 


(2)  ,(2) 


where  Aj  , and  X ^  J  , . . . ,  }  are  the  eigenvalues  of  and 


Pi 
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.,-1 


~22>  respectively,  and  ^  =  C"  Z^cf  ,  E22  =  C"  E^C’ 

2l5l  =  ~H  anci  52^2  =  ~22'  t^ie  a^ove  function  in  the  braces  is 

a  symmetric  function  of  A.^ . A^  ,  A^2^ . \^2\  these  {A^} 

1  Pi  1  P2  J 

must  be  equal.  We  have 


max  L(y,E  ) 

v  ,  50>o  ~ 


max  {-(np/2)  log  A  +  log  g(p/A)  -  (n/2) (log  I W1 . 

A  >  0  "ii 


+  log|W22|)) 


=  log{A  (g) 
&  max  6; 


-np/2 


s<pAmaK(s» 


Hu 


I -n/2 


?22 


I -n/2. 


which  completes  the  proof,  Q.E.D. 

Theorem  4.  Under  the  assumptions  of  Theorem  1,  the  likelihood  ratio 
criterion  for  testing 


(3.4) 


H:~ij  °>  1  **  3  *  1»3  -1-’ 


q  . 


is 


(3.5) 


and 


(3.6) 


max  L(y,En) 
max  L(y  E) 

y,E  >  o 


f 


w 


n/2 


T2/n  d 


q 

n  v. 


J-2  J 


5 


where  v2»,#,*clq  are  independent  and  U 


-  j;x 

p.,p.,n-p.  wit^  Pj  I  Pj[‘ 
3  3  J  i=l 
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Proof .  The  criterion  (3.5)  is  from  (2.10)  and  (3.3).  By  (2.4), 


X  =  e  u'  +  RUA.  Partition  A  into  A  =  (A.. , 
~  ~n~  —  ~  ~1  ’ 

j  =  1 , . . . , q .  Then 


•»A  )  with  A  :p  x  p 
~4  ~J  J 


where 


W  =  R2A’U'DUA  =  R2A’Y'DYA/tr  Y’Y 

W. .  =  R2A!U’DUA.  =  R2A:Y'DYA./tr  Y’Y,  i  = 

~JJ  ~J - J  ~J - J  ~  ~ 

D,U  and  Y  have  the  same  meaning  as  before.  Thus 


9 


(3.7)  x2/n  =  |a’y'dya|/  n  (A.'Y'DYA.  I  , 

j=l  J  J 

c\  J 

and  the  distribution  of  t  is  independent  of  any  specific  form  of  the 

density  in  the  class  of  MECD.  In  particular  we  can  consider 

x...  ^  N  (y,Z)  independently,  j  =  l,f..,n*  Hence  (3.6)  follows  by 
^  \  j  /  P  ~  ~ 

Anderson  (1958),  Chapter  8.  Q.E.D. 

When  q  =  2,  p^  =  1  and  p^  =  p  -  1,  testing  the  null  hypothesis 

-2 

^12  =  ®  is  equivalent  to  testing  R  «  0,  where  R  is  the  multiple 
correlation  coefficient.  (cf ,  Theorem  5  of  Anderson  and  Fang  (1982b).) 


3 .2  Testing  the  hypothesis  that  a  mean  vector  is  equal  to  a  given  vector. 
Consider  the  hypothesis  H:y  =  y  .  The  likelihood  criterion  is 

'V  'vU 

T  =  max  L(ii_,£)/  max  L(]i,E) 

I  >  0  ~  ii,E  >  0 

By  a  method  similar  to  that  used  before  we  find 
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> 


"fn  l(ho’5)  -  ^x^)‘np/2s(p/\ax(g)>iw0rn/2 

Zi  \J 


where 


n 


?0  ■  I^-D-iioXiarV 


Thus 


T 


2/n 


|w|  M  1 

|w  +  n(x-yQ)  (x-yQ) ’|  l  +  T2/(n-l) 


where 


T2  =  n(n-l) (x-yQ) 'W  1(x-y())  , 


which  is  the  same  as  in  the  normal  case.  Also,  if  the  null  hypothesis 

2 

is  true,  the  distribution  of  T  is  the  same  as  in  the  normal  case.  (cf. 
Theorem  6  of  Anderson  and  Fang  (1982b).) 


3 .3  Testing  the  hypothesis  of  equality  of  covariance  matrices. 

Now  we  consider  the  case  that  the  sample  are  from  q  populations 
with  mean  vectors  y  . . .  ,y  ^  and  covariance  matrices  , 

^  ~  ~-L 

respectively.  Assume  that  the  joint  distribution  of  the  samples  is  a  multi¬ 
variate  elliptically  contoured  distribution,  i.e.,  the  data  matrix 

X  MLE  (Mj  ]C-  ,  • . . ,  2.-  ,  Urt ,  •  • . ,  , » •  • ,  S  }  (j))  with  n  2  *  s 

^  n  x  p  ^  — L  ~z  ~q  ~q  i  ^1 

n2  ni  >  P>***>nrt  >  P»  ni  +  +  •  •  •  +  =  n  and  the  rows  of 


q  ~q  1  **  ’  q  1  2  q 
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M  are  y^'s,  n2  y^'s . nq  y^'s,  successively.  From  (1.4) 

the  density  of  X  is 


(3.8)  L(y(1),...,y(q);E1,...,Z)  =  S  |Z,|  ^  g(  ?  tr  Z.V.)  , 

~  ~  JL  ~  U  (  .  4  'vi  »  -1  <V  J.  X 


where 


G .  =  Z  1  (x  -y(l))(xf  .-y(l))’ 

~X  j=n .  _+l  ~'J'  ~  ~ 

J  1-1 


with  n,.  =  0,  n,  =  n.  4-  •••  +  n.. 

0  9  i  1  l 

We  wish  to  test  the  hypothesis 


(3.9) 


EL  :E1  «  X0  =  •••  -  E 
1  ~1  -2  ~q 


Lemma  5 .  Under  the  assumptions  of  Theorem  1 


(3.10) 


L(y(1),...,y(q);Z1  ,...,E  ) 

-v  ^  -vi  ~  q 


.  ,yV4/ , >  0, . . .  ,E  > 0 


/0  q  n.  pn./2  -n./2 

np/  [  n  (-~)  1  |w,|  1 


=  x  (g)  n  (— 

max  6  .  ,  n 

i=l 


|W±|  ls(P/xmax(g))  , 


where 


W.  -  Z  1  (x,..-x(l))(x.  ,-x(l))'  , 

-1  j=n.  ,+1  '(J)  '  '<;l)  ' 

J  1-1 


i—  l,...,q  5 


x(l)  =  (1/n  )Z  1  x.  .  . 

J^i-1+1  J 
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Proof .  By  a  method  similar  to  that  used  in  the  proof  of  Theorem  1, 
we  have 


max  log  L(y  \...,y^;£, . S  ) 

m  ~  -1  ~q 

y  W  ,Z  .  >  0 


max 


Z.  >  0, . .  .  ,S  >  0 

■vX  ~  q 


log  L(x(1) . x(q);Z,  ) 

~  ~  ~X  ^q 


max 


{“(1/2)  l  l  i^logA' 

i)  >  0,  j=l . n.  1=1  j=1 

i=l, . . .,q 


(i) 


q  p 


+  log  g(  l  I  A?l}  x)  -  (1/2)  log  l  n.  log  |w.  |  } 
i=l  j=l  3  i=l  1  -1 


where  A,^ ,  . . .  ,A^  are  the  eigenvalues  of  E,  =  CT^E.C!  ^  and  C  C1  =  W  . 

1  p  ~i  ~i  ~i~i  ~i 

Because  iu  >  p,  W_^  >  0  with  probability  one  by  Lemma  1  (i  = 

The  function  in  the  above  braces  is  a  symmetric  function  of  X^\  . .  •  ,X^*^ 

-  P 

for  i  =  Therefore  =  •  •  •  =  X^^  =  X^^  and  the  quantity  in  the 

braces  becomes 


(3.11)  -(p/2)  l  n  log  A^  +log  g(p  l  XV1''"'J')  -  (1/2)  £  n  log  |w  |  =  L*  , 
i=l  1  i=l  i=l  1  ~1 


(i)-l. 


say. 


Let  3L*/3X(l)  =0,  i  =  l,...,q. 


We  have 


(i) 


g,(pIX(i)"1) 


n,-  q 


i  “  -^  *  *  •  *  *  *1  9 


1  8(P t  A^"1) 
1 
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and  A^/X^  =  n-^Au,  i  =  Let  A  =  A^n^/n,  then 

X^  =  nA/n_^,  i  =  l,...,q,  and  (3.11)  becomes 


n  q 

-(np/2)  log  A  +  log  g(p/A)  -  (pn/2)  log  n  -  (p/2)  ][  n  log  n  -  (1/2)  ][  n  log  |w. 

,  >  1  1  ,  -  1  ~ -L 

1=1  1=1 


which  completes  the  proof*  Q.E.D. 
Similarly,  we  find 


(3.12) 


max 


,2) 


=  X 


max 


(g)~np^2g(p/Xmax(g))  1^  +  ...  + 


w  | _n/2  . 

~q 


Thus  we  obtain  the  following  theorem: 

Theorem  5.  Under  the  above  assumptions  the  likelihood  ratio  criterion  for 
testing  (3.9)  is 


(3.13) 


T,  = 


n  [(- 

i=l  i 


|W±| 


I  I  HI 

3=1  J 


n .  /  2  pn .  /  2 

-)  1  (f-)  1  ] 

i  i 


which  has  the  same  distribution  as  in  the  normal  case. 

The  distribution  of  was  discussed  by  Anderson  (1958), 

10.  A  sufficient  set  of  statistics  is  W.,...,W 


q 


Chapt  er 
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3.4  Testing  equality  of  several  means. 


Assuming  2^  2^  2,  say,  we  want  to  test  the  hypothesis 

(3.14)  H2:y(1)  =  ...  =  y(q)  . 

The  corresponding  likelihood  ratio  criterion  is 


max 


,(D 


(4.15)  t2  = 


. ,2  >  0 


L(y(1),...,U(q);2,...,2) 


W 


,n/2 


max  L(y, . . .  ,y;2 . 2) 

y,2  >  0 


W  4*  •  •  *  +  W 

~i  ~q 


in/ 2 


where  W  is  defined  by  (2.2). 

It  is  well-known  that  the  hypothesis  can  be  expressed  as  a  linear 

hypothesis  which  will  be  discussed  in  the  next  section. 


3.5  Testing  equality  of  several  means  and  covariance  matrices. 

We  want  to  test 

(3.16)  H:]i^  =  ...  =  and  £=•••=£ 

-i  -q 

From  Lemma  10.3.1  of  Anderson  (1958),  the  likelihood  ratio  criterion  for 
the  hypothesis  H  is  the  product  of  the  likelihood  ratio  criteria  for 
and  ,  i . e . 
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(3.17) 


q  W.  n./2  pn  Jl 
4  /  -x  x  1  ,  nN^  x 


t  °  tit2  •  ,n.  <f?r> 

1=1  1  -  1  1 


which  has  the  same  distribution  as  in  the  normal  case. 

3 . 6  Testing  the  hypothesis  that  a  covariance  matrix  is  proportional  to  a 
given  matrix. 

Now  we  come  back  to  the  case  of  X  'u  LEX  (u,E,cf>)  and  want  to  test 

n  x  p  z’ 


(3.18) 


H:5  0  ?0’  ~o  >  0  ’ 


where  E^  is  given.  First,  we  assume  E^  =  and  decompose  the 
hypothesis  H  into  H^:E  is  diagonal  and  H^Jthe  diagonal  elements  of 


E  are  equal,  given  E  is  diagonal.  Let  E^  =  diag  (a^ ,  .  .  . ,  CF  )  anc^ 
2 


2  2 

E9  =  diag(a  , ...,G  ).  It  follows  from  Lemma  4  that 


(3.19)  max  L(y,E.,)  =  A  (g)~np/,2g(p/X  (g))  (  II  w  .,)  n^2 

U,E1>  0  ~  ^  maX  j=l  12 


where  w  is  the  j-th  diagonal  element  of  W.  Similarly 


(3.20)  max  L(y,Ej  =  *  x(g)  nP/,2g(pAmax(g))  (tr  ?/p)  np^2 

y,cr  >  0  ' 


Then  we  have 


max  L(y,E^) 


(3.21) 


y»  E,  >o 


w 


n/2 


T1  max  L(y,E) 


y,E  >  0 


p  n/2 

n  w. . 
j-i  ^ 
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p 


(3.22) 


max  L(y,E  ) 

y,cr  >0  ~":' 


X2  = 


P  n/2 

TT  W*  • 

_  Ai£_ 


max  («  w/p)»p/2  • 


>  ° 


and 


(3.23) 


|w|n/2 

(tr  W/p)np/2 


When  E  ^  I  ,  the  corresponding  criterion  is 

~p 


(3.24) 


T  = 


I  ln/2 


(tr  Z^W/p)111^2 


which  has  the  same  distribution  as  in  the  normal  case,  (cf.  Anderson 
(1958),  Chapter  10). 


3.7  Testing  the  hypothesis  that  a  covariance  matrix  is  equal  to  a  given 
matrix. 

We  wish  to  test  Z  =  En>  0,  where  En  is  given.  The  corresponding 

^  ^\J  ^/U 

likelihood  ratio  criterion  is 

<3'25)  T  -  X„ax<s)nP/V1(p/^a!t(s))g(tr  S-1«ISo1|n/2  ' 

Note  that  the  distributions  of  T  are  not  the  same  in  the  class  of  MECD 
and  depend  on  <f).  Similarly,  we  find  that  the  likelihood  ratio  criterion 
for  testing  H:E  =  Eq  and  y  =  y^  is 
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(3‘26)  T  =  Xmax(s)nP/2g  1(pAmax(S))S(tr  5)V + w ' Zo' >  •  Sr? 


4 .  Testing  the  general  linear  hypothesis. 

Consider  the  following  multiple  regression  model: 


Y  =  X  B  +E  ,p  +  q<n,  r  k  X  =  q  , 

-n  x  p  -n  x  q.q  x  p  ^nXp’  ^  n  V  ^  H  • 

(4.1)  (  E  ^  LEC  (0,E,(j))  with  a  density  |E|  n^g(tr  E  ^G)  and 

n  ^  p  ^  /v  a/ 


where  g(*)  is  a  decreasing  and  differentiable  function 


We  want  to  find  the  maximum  likelihood  estimates  of  B  and  E.  As 
L(B,E)  =  |E|"n/2g(tr  E_1G) 

,  ,  _ -n  /  9  _1  /s  /\  z\  —1  ^ 

=  |E|  '  g(tr  E  (Y-XB) ’ (Y-XB)  +  tr (B-B)XE  X'(B-B)')  , 

where 

(4.2)  B  =  (X'X^X'Y  , 

/s 

the  MLE  of  B  is  the  least  squares  estimate  B  (cf .  Sec.  7,  Anderson 
and  Fang  (1982b)).  Maximizing 

L(B,E)  =  1 E |  '  g(tr  E  (Y-XB) ' (Y-XB) ) 

with  respect  to  E  gives  the  maximum  likelihood  estimator 


n/2 
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l  O 


(4.3) 


^  =  A (g) (Y-XB) ' (Y-XB) 

~  l  lid  A.  ~  ~  ~  ~ 


and 


(4.4)  L(B,E)  =  max  L(B,E)  =  A  (g)  np/2 ] (Y-XB) ' (Y-XB) |_n/2g(p/A  (g))  , 

B, E  >  0  ~~  -  -  max 


where  ^max(§)  has  t^ie  same  meaning  before. 

Similarly,  the  unbiased  estimators  of  B  and  E  are  B  and 


E  =  - S2 — »  (Y-XB)  '  (Y-XB) 

(n-q)ERZ  ~  *"v 


respectively,  if  the  second  moments  of  components  of  E  exist.  A  sufficient 
set  of  statistics  is  B  and  Z ♦ 

We  want  to  test  the  following  linear  hypothesis: 

(4.5)  H:HB  =  C,  H:t  x  q?  C:txp  and  rk  H  =  t  <  p 

It  is  easy  to  show  that 


(4.6)  max  L(B,E)  =  A  (g)  np/2g (p/A(g) ) | S  +t|  n/2 

HB  =  C , E  >  0  ~  ~  maX  maX  ~  ~ 


where 


S  =  (Y-XB) * (Y-XB) 
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Thus  the  likelihood  ratio  criterion  for  H  is 


max  L(B,E) 

B,E  >  0  ~  ~  |g|-n/2 

T  max  L(B,E)  ,  i-n/2 

HB  =  C ,  E  >0  ~  ~  I S  +  T I 

which  has  the  same  distribution  as  in  the  normal  case  (cf .  Theorem  12  of 
Anderson  and  Fang  (1982b),) 

We  summarize  the  above  results  as  follows: 

Theorem  6,  Under  the  model  (4.1)  the  maximum  likelihood  estimators  of 

B  and  Z  are  (4.2)  and  (4. 3), respectively.  The  likelihood  ratio 

statistic  for  testing  the  hypothesis  (4.5)  is  (4.7)  and  the  distribution 

of  T  is  U  when  the  null  hypothesis  is  true. 

p,t,n-q 

Acknowledgment .  The  second  author  was  supported  by  Academia  Sinica. 


REFERENCES 


Anderson,  T.  W.  (1958),  An  Introduction  to  Multivariate  Statistical 
Analysis,  John  Wiley  and  Sons,  New  York. 

Anderson,  T.  W.,  and  Fang,  K.  T.  (1982a),  Distributions  of  quadratic 

forms  and  Cochran's  Theorem  for  elliptically  contoured  distributions 
and  their  applications.  Technical  Report  No.  53,  ONR  Contract 
N00014-75-C-0442,  Department  of  Statistics,  Stanford  University, 
Stanford,  California. 

Anderson,  T.  W.,  and  Fang,  K.  T.  (1982b),  On  the  thoery  of  multivariate 
elliptically  contoured  distributions  and  their  applications. 
Technical  Report  No.  54,  ONR  Contract  N00014-75-C-0442 ,  Department 
of  Statistics,  Stanford  University,  Stanford,  California. 

Cambanis,  S.,  Huang,  S.,  and  Simons,  G.  (1981),  On  the  theory  of  ellipti— 
cally  contoured  distributions.  Journal  of  Multivariate  Analysis, 

11,  368-385. 

Chmielewski,  M.  A.  (1980),  Invariant  scale  matrix  hypothesis  tests  under 
elliptical  symmetry,  Journal  of  Multivariate  Analysis,  10,  343-350. 

Dawid,  A.  P.  (1977),  Spherical  matrix  distributions  and  a  multivariate 
model.  Journal  of  the  Royal  Statistical  Society,  B,  39,  254-261. 

Dawid,  A.  P.  (1978),  Extendibility  of  spherical  matrix  distributions, 
Journal  of  Multivariate  Analysis,  8,  559-566. 

Johnson,  N.  J.,  and  Kotz ,  S.  (1972),  Distributions  in  Statistics: 

Continuous  Multivariate  Distributions,  John  Wiley  and  Sons,  New  York. 

Schoenberg,  I.  J.  (1938),  Metric  spaces  and  completely  monotone  functions, 
Annals  of  Mathematics.  39,  811-841. 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  (When  Data  Entered) 


ranin 


1.  REPORT  NUMBER 


2.  GOVT  ACCESSION  NO. 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


3.  RECIPIENT'S  CATALOG  NUMBER 


4.  TITLE  ( and  Subtitle) 

Maximum  Likelihood  Estimators  and  Likelihood 
Ratio  Criteria  for  Multivariate  Elliptically 
Contoured  Distributions 


5.  TYPE  OF  REPORT  &  PERIOD  COVERED 


Technical  Report 


6.  PERFORMING  ORG.  REPORT  NUMBER 


7.  AUTHORfs) 

T.  W.  Anderson  and  Kai-Tai  Fang 


8.  CONTRACT  OR  GRANT  NUMBER^ 


D AAG 29-82- K- 0156 


9.  PERFORMING  ORGANIZATION  NAME  AND  ADDRESS 

Department  of  Statistics,  Sequoia  Hall 
Stanford  University 
Stanford,  California 


n.  CONTROLLING  gF^^^^  ^|SS 

Post  Office  Box  122.11 
Research  Triangle  Park,  NC  27709 


10.  PROGRAM  ELEMENT,  PROJECT,  TASK 
AREA  ft  WORK  UNIT  NUMBERS 

P-19065-M 


12.  REPORT  DATE 


bBIiI  HIM  I  iPlJKiqBl 


13.  NUMBER  OF  PAGES 


14.  MONITORING  AGENCY  NAME  ft  ADDRESS^//  different  from  Controlling  Office)  15.  SECURITY  CLASS,  (of  this  report) 

UNCLASSIFIED 

15a.  DECLASSIFICATION/DOWNGRADING 
SCHEDULE 


16.  DISTRIBUTION  STATEMENT  (of  thio  Report) 


S for  pub,k 


17.  DISTRIBUTION  STATEMENT  (of  the  abatract  entered  in  Block  20,  if  different  from  Report) 


AND/OR  FINDINGS  CONTAINED  IN  THIS  REPORT 
SI  THOSE  OF  THE  AUTHCR(S)  AMO  SHOULD  NOT  RE  CONSTRUED  AS 
■^OFFICIAL  DEPARTMENT  OF  THE  ARM  -  » 

CISIOM.  UNLESS  SO  DESIGNATED  BY  OTHvH 


19.  KEY  WORDS  (Continue  on  reverse  side  if  necessary  and  identify  by  block  number) 

Likelihood  ratio  criteria,  maximum  likelihood  estimators,  multiple  regression 
model,  multivariate  elliptically  contoured  distributions. 


20L  ABSTRACT  (Continue  on  reverse  sBcbs  ff  necessary  and.  identity-  by  block  number) 

In  this  paper  we  generalize  the  theory  of  maximum  likelihood  estimation 
and  likelihood  ratio  criteria  from  normal  distributions  to  multivariate  ellip¬ 
tically  contoured  distributions  for  which  the  vector  observations  are  not 
necessarily  either  normal  or  independent.  We  find  that  many  usual  likelihood 
ratio  criteria  and  their  null  distributions  are  the  same  in  the  class  of  mul¬ 
tivariate  elliptically  contoured  distributions. 


FORM 
t  JAM  73 


EDITION  OF  1  MOV  65  IS  OBSOLETE 


UNCLASSIFIED _ 

SECURITY  CLASSIFICATION  OF  THIS  PAGE  ('Wfeert  Defa  Entered) 


